PROCESSED IMAGE DATA TRANSMITTING SYSTEM, PORTABLE 
TELEPHONE AND PROCESSED IMAGE DATA TRANSMISSION PROGRAM 

BACKGROUND OF THE INVENTION 
5 1. Field of the Invention 

The present invention relates to a processed image 
data transmitting system, portable telephone, and processed 
image data transmission program, particularly, to a 
processed image data transmitting system handling e-mails, 
10 and processed image data transmission program. . 

2, Description of the Related Prior Art 
The technique described in the Japanese Unexamined 
Patent Application Publication No. 2002-152341 is a 
technique related with ^^a portable telephone device 
15 equipped with a camera unit for acquiring image data of an 
object by photographing the object, the device comprising 
an image signal processing means for receiving image data 
from the camera unit, and processing the data; a memory 
means for storing the processed image data; and an image 
20 .comparing means for comparing groups of processed image 
data thus acquired with each other." 

The technique described in the Japanese Unexamined 
Patent Application Publication No. 11-136612 is a technique 
related with ^''an image data transmitting apparatus 
25 comprising an electronic camera constituted so as to 
receive the insertion of a memory card and capable of 
automatically transmitting electronic image data acquired 
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by the camera to a separate, external apparatus to which 
the electronic image data is addressed, the automatic 
transmission of image data to the addressee being achieved 
by relating said image data with data including a unique 
5 number assigned to the addressee, storing the relation, and 
transmitting, after being connected to a transmitting means 
such as a portable telephone, said image data to the 
addressee based on the stored relation, and a transmitting 
circuit which automatically connects the apparatus to a 

10 telephone line leading to the addressee based on the unique 
number data stored in the memory card." 

The technique described in the Japanese Unexamined 
Patent Application Publication No. 6-168317 is a technique 
for identifying a subject by extracting characteristic 

15 points from image data of the subject's face fed externally, 
comparing the characteristic points with similar 
characteristic points of human faces stored in a database 
for identification, and calculating a distance between each 
pair of corresponding characteristic points. 

20 SUMMARY OF THE INVENTION 

The object of the present invention is to improve 
convenience in the transmission of e-mails, by 
automatically extracting the address of a subject whose 
image is acquired by a camera, and transmitting an e-mail 

25 carrying the image of the subject to the address thus 
extracted. 

A processed image data transmitting system of the 
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invention comprising : 

means for preparing a still image of a subject from 
video image of the subject acquired by a camera, comparing 
characteristic point data extracted from the still image of 
5 the subject with corresponding characteristic point data 

obtained from the image data of persons stored in a memory, 
extracting an e-mail address stored in connection with a 
person whose characteristic point data are most 
correspondent to those of the subject, and transmitting an 

10 e-mail to which the still image of the subject is attached 
to the e-mail address thus extracted. 

A portable telephone of the invention comprising: 
' means for preparing a still image of a subject from 
video image .of the subject acquired by a camera, comparing 

15 characteristic point data extracted from the still image" of 
the subject with corresponding characteristic point data 
obtained from the image data of persons stored in a memory, 
extracting an e-mail address stored in connection with a 
person whose characteristic point data aire most 

20 correspondent to those of the subject, and transmitting an 
e-mail to which the still image of the subject is attached 
to the e-mail address thus extracted. 

A processed image data transmission program for 
causing a computer to perform a process comprising: 

25 preparing a still image of a subject from video image 

of the subject acquired by a camera, comparing 
characteristic point data extracted from the still image of 
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the subject with corresponding characteristic point data 
obtained from the image data of persons stored in a memory, 
extracting an e-mail address stored in connection with a 
person whose characteristic point data are most 
5 correspondent to those of the subject, and transmitting an 
e-mail to which the still image of the subject is attached 
to the e-mail address thus extracted. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other objects, features and advantages 
10 of the present invention will become apparent from the 
'following detailed description when taken with the 
accompanying drawings in which: 

FIG. 1 is a block diagram for illustrating the 
constitution of an embodiment of the present invention; 
15 FIG. 2 is a flowchart for illustrating the operation 

of the embodiment of the present invention; 

FIG. 3 is a subsequent flowchart for illustrating the 
operation of the embodiment of the present invention; 

FIG. 4A illustrates a series of displays exhibited on 
20 the screen; 

FIG. 4B illustrates a series of displays exhibited on 
the screen; 

FIG. 4C illustrates a series of displays exhibited on 
the screen; 

25 FIG. 5A illustrates a subsequent series of displays 

exhibited on the screen; and 

FIG. 5B illustrates a subsequent series of displays 
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exhibited on the screen. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Next, a first embodiment of the present invention will 
be detailed with reference to the accompanying drawings. 
5 Referring to FIG. 1, a device representing the first 

embodiment of the present invention comprises an antenna 11 
for transmitting/receiving RF (radio-frequency) signals via 
a wireless channel to/from a base station and a 
communication management portion 12; a display output 

10 portion 13 responsible for display (e.g., finder); an input 
portion 14 through which the device receives input fed by . 
the user (e.g., keys, mouse and/or buttons); a memory 
portion 16 (e.g., memory device such as a memory, hard-disk 
or. the like) for storing e-mail data, dial data, and camera 

15 images; a camera terminal 17 connected to a camera for 
acquiring camera images; and a control portion 18. 

The memory portion 16 stores, in advance, image data 
of one or more persons, and dial data of those persons in 
connection with their image data. The dial data of a given 

20 person includes his/her phone number, e-mail address, etc. 
The control portion 18 comprises a camera control 
portion 81 for controlling the camera in the acquisition of 
camera images; a mail communication control portion 82 
responsible for the transmission/reception of e-mails; a 

25 characteristic point extracting portion 83 for extracting, 
when the user takes a camera image of a subject and 
requires the transmission of an e-mail, characteristic 
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points (subject characteristic points) from the camera 
image of the subject under the control of the camera 
control portion 81; a characteristic point comparing 
portion 84 for comparing the subject characteristic points 
5 extracted by the characteristic point extracting portion 83 
with corresponding characteristic points extracted from the 
image data of persons which are stored in the memory 
portion 16 in connection with the dial data of those 
persons, and determining a registered person whose image 

10 data give characteristic points least departed from (or 

most correspondent with) the subject characteristic points 
and picking up an e-mail address from dial data stored in 
connection with the person; and an e-mail preparation 
management portion 85 for attaching the image acquired by 

15 the camera to an e-mail, and instructing the mail 

communication control portion 82 to transmit the e-mail to 
the e-mail address picked up above. 

The device representing the first embodiment of the 
present invention may be a portable telephone. 

20 Now, the operation of the first embodiment of the 

present invention will be described with reference to 
attached drawings. 

Firstly, steps required for the acquisition of a' 
subject image with a camera up to the extraction of 

25 characteristic points from -the subject image for 

characterizing the subject will be described with reference 
to FIG. 2. 
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When a user activates the camera control portion 81 of 
control portion 18 via the input portion 14 (step S21 in 
FIG. 2), the camera control portion 81 receives a camera 
image of a subject acquired by a camera connected to the 
5 camera terminal 17 via the camera terminal 17 (step S22) , 
and delivers the camera image to the display output portion 
13 which then presents a first display including the camera 
image of the subject (step S23) . 

Referring to FIG. 4(a), the first display includes 
10 video image 41 representing the subject, a photographing 
button 42 and a menu, button 43. 

When the user selects an image of the subject by 
activating the photographing button 42 via the input 
portion 14, the camera control portion 81 captures that 
IS image from the video image 41 presented on the display 

output portion, 13, and stores the image in the interior of 
the camera control portion 81 as a still image 41b 
representing the subject (step S24). 

Next, the camera control portion 81 delivers output 
20 required for the presentation of a second display including 
the still image 41b stored as above to the display output 
portion 13 which then presents the second display including 
the still image 41b (step S25) . 

The second display shown in FIG. 4(b) includes the 
25 still image 41b and menu button 43. 

When the user activates the menu button 43 via the 
input portion 14, the camera control portion 81 delivers 
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output required for the. presentation of a third display 
including the still image 41b to the display output portion 
13 which then presents the third display including the 
still image 41b (step S26) . 
5 The third display shown in FIG. 4(c) includes a menu 

(comprising, for example, storage, mail preparation, mail 
transmission, image viewing and deletion) , and decision 
button 45. 

When the user selects ^'mail transmission to a 

10 registered .person" in the menu 44 via the input portion 14, 
and confirms the selection by clicking the decision button 
45, the camera control portion 81 takes the still image 41b 
stored in its interior and delivers the image to the 
characteristic point extracting portion 83 and also 

15 delivers output required for the presentation of a fourth 
display to the display output portion 13 which then' 
presents a fourth display (step S27). 

The fourth display shown in FIG. 5(a) includes a mail- 
transmission display 4 6 which tells the user that ^^the mail 

20 is being transmitted." 

The characteristic point extracting portion 83, on 
receipt of the still image 41b from the camera control 
portion 81, extracts characteristic point data from the 
still image 41b (step S28) . 

25 The characteristic point extracting portion 83 

inspects, for example, the eyes, eye-brows, nose, mouth, 
cheeks, and facial contour of the subject's face 
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represented by the still image 41b, and obtains 
characteristic point data (subject characteristic point 
data) as a result of the inspection. 

Next, the characteristic point extracting portion 83 
5 reads the image data of persons stored in the memory 

portion 16, obtains corresponding characteristic point data 
(step S29) , and delivers the characteristic point data of 
the registered persons as well as the subject 
characteristic point data obtained from the still image 41b 

10 of the subject to the characteristic point comparing 

portion 84. The image data of each registered person is 
connected with his/her dial data. 

The characteristic point comparing portion 84 then 
compares the subject characteristic point data obtained 

15 from the still image 41b with the corresponding 

characteristic point data obtained from the image data of 
the registered persons (step S30) . 

The characteristic point comparing portion 84' 
determines a registered person whose characteristic point 

20 data are least departed from the subject characteristic 
point data (least, for example, in terms of the distance 
between each pair of characteristic points taken for 
comparison) , and fetches dial data related with the person 
from the memory portion 16 (step S31 "in FIG. 3) , and 

25 delivers the dial data to the e-mail preparation management 
portion 85. To achieve the last-mentioned step, the 
technique described, for example, in the Japanese 



10 



Unexamined Patent Application Publication No. 6-163817 may 
be employed. 

On receipt of the dial data from the characteristic 
point comparing portion 84, the e-mail preparation 
5 management portion 85 fetches the still image 41b from the 
camera control portion 81, and picks up an e-mail address 
(which is most probably the address of the subject 
represented by the still image) contained in the dial data 
(step S32) . 

10 The e-mail preparation management portion 85 causes 

the still image 41b to be attached to an e-mail to be sent 
to the address picked up above (step S33) and delivers the 
e-mail to the mail communication control portion 82. 

On receipt of the e-mail from the e-mail preparation 

15 management portion 85, the mail communication control 
portion 82 transmits the e-mail via the communication 
management portion 12 and antenna 11 (step S34), 

The mail communication control portion 82 then 
delivers a signal notifying the completed transmission of 

20 the e-mail to the camera control portion 81, and the camera 
control portion 81, on receipt of the signal notifying the 
completed transmission of the e-mail from the mail 
communication control portion 82, delivers output required 
for the presentation of a fifth display to the display 

25 output portion 13 which then presents a fifth display (step 
S35) . 

The fifth display shown in FIG. 5(b) includes a 
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message 47 announcing the completion of mail transmission 
and termination button 48. 

When the user selects the termination button 48 on the 
fifth display via the input portion 14, the camera control 
5 portion 81 delivers output required for the presentation of 
a first display to the display output portion 13 which then 
displays a first display. 

To cope with a situation where a still image of a 
subject acquired by a camera has' an expression considerably 

10 diverted from his/her normal expression, the characteristic 
point extracting portion 83 may be constructed so as to be 
able to detect physical traits responsible for the diverted 
expression, and to modify the image as appropriate to 
compensate for the diversion, for example, to cause the 

15 mouth to be closed when said portion 83 finds the subject's 
mouth open, thereby improving the accuracy of comparison 
when characteristic point data extracted from the subject's 
• image are compared with corresponding characteristic point 
data of registered persons. 

20 Alternatively, the characteristic point extracting 

portion 83 may be constructed so as to be able to modify, 
when said portion 83 finds an image of a comparable person 
represented by image data stored in the memory portion 16 
exhibits a face having an open mouth, the subject's face in 

25 the still image 41b to match the face of the comparable 

person, i.e., to cause the subject's face to have an open 
mouth, thereby improving the accuracy of comparison between 
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the subject and the person. 

If the device is incorporated in a portable telephone, 
necessary steps will be simplified, and convenience will be 
improved. 

5 A second embodiment of the present invention is a 

method for transmitting processed image data by using a 
device comprising camera control portion, display output 
portion, characteristic point extracting portion, 
characteristic^ point comparing portion, mail preparation 

10 management portion and mail- communication control portion, 
the method comprising the steps of causing the camera 
control portion to receive a camera image of a subject 
acquired by a camera (step S22 in Fig. 2), to deliver 
output necessary for the presentation of a first display 

15 including video image 41 representing the camera image and 
a photographing button 42, to capture, from the video image 
. 41, an image which a user selects by clicking the 
photographing button 42, to store the image as a still 
image 41b in a memory (step S24), to deliver output 

20 necessary for the presentation of . a second display 

including the still image 41b and menu button 43, to 
deliver, in response to the clicking of the menu button 43, 
output necessary for the presentation of a third display 
including the details of the menu containing, e.g., e-mail 

25 transmission, and to fetch, when the user clicks the e-mail 
transmission of the menu 44, the still image 41b from the 
memory; causing the display output portion to present the 
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first, second and third displays on receipt of the outputs 
from the camera control portion (steps S23, S25 and S26) ; 
causing the characteristic point extracting portion to 
receive the still image 41b from the camera control portion, 
5 to prepare characteristic point data from the still image 
41b (step S28), to read image data of persons stored in a 
memory portion 16, and to prepare, corresponding 
characteristic point data from the stored image data of the 
persons (step S29) ; causing the characteristic point 

10 comparing portion to receive, from the characteristic point 
extracting portion, the characteristic point data prepared 
from the still image 41b of the subject as well as the 
characteristic point data prepared from the image data of 
the persons stored in the memory portion, to compare the 

15 subject characteristic point data with the corresponding 
characteristic point data of the registered persons (step 
S30), to determine a person whose characteristic point data 
are most highly correspondent with those of the subject-, 
and to read dial data connected with the person from the 

20 memory portion 16 (step S31) ; causing the mail preparation 
management portion to receive the dial data from the 
characteristic point comparing portion, to fetch the still 
image 41b from the camera control portion, to pick up an e- 
mail address contained in the dial data (step S32) , and to 

25 attach the still image 41b to an e-mail to be sent to the 
e-mail address (step S33) ; and causing the mail 
communication control portion to receive the e-mail from 
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the mail preparation management portion and to transmit the 
e-mail to the address (step S34 in FIG, 3) . 

^Next, a third embodiment of the present invention will 
be detailed with reference to the accompanying drawings. 
5 The third embodiment of the present invention is a 

program for a computer installed in a device (e.g., 
portable telephone) comprising camera control portion, 
display output portion, characteristic point extracting 
portion, characteristic point comparing portion, mail 

10 preparation management portion and mail communication 
control portion, the computer, based on the program, 
instructing the camera control portion to receive a camera 
image of a subject acquired by a camera (step S22 in Fig. 
2) , to deliver output necessary for the presentation of a 

15 first display including video image 41 representing the 
-camera image and a photographing button 42, to capture, 
from the video image 41, an image which a user selects by 
clicking the photographing button 42, to store the image as 
a still image 41b in a memory (step S24), to deliver output 

20 necessary for the presentation of a second display 

including the still image 41b and menu button 43, to 
deliver, in response to the clicking of the menu button 43, 
output necessary for the presentation of a third display . 
including the details of the menu containing, e.g., e-mail 

25 transmission, and to fetch, when the user clicks the e-mail 
transmission of the menu 44, the still image 41b from the 
memory; instructing the display output portion to. present 
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the first, second and third displays on receipt of the 
outputs from the camera control portion (steps 523, S25 and 
S26) ; instructing the characteristic point extracting 
portion to receive the still image 41b from the camera 
5 control portion, to prepare characteristic point data from 
the still image 41b (step 328), to read image data of 
persons stored in a memory portion 16, and to prepare 
corresponding characteristic point data from the stored 
image data of the persons (step S29) ; instructing the 

10 characteristic point comparing portion to receive, from the 
characteristic point extracting portion, the " characteristic 
point data prepared from the still image 41b of the subject 
as well as the characteristic point data prepared from the- 
image data of the persons stored in the memory portion, to 

15 compare the subject characteristic point data with the 

corresponding characteristic point data of the registered 
persons (step S30), to determine a person whose 
characteristic point data are most highly correspondent 
with those of the subject, and to read dial data connected 

20 with the person from the memory portion 16 (step S31) ; 
instructing the mail preparation management portion to 
receive the dial data from the characteristic point 
comparing portion, to fetch the still image 41b from the 
camera control portion, to pick up an e-mail address 

25 contained in the dial data (step S32), and to attach the 
still image 41b to an e-mail to be sent to the e-mail 
address (step S33); and instructing the mail communication 
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control portion to receive the e-mail from the mail 
preparation management portion and to transmit the e-mail 
to the address (step S34 in FIG. 3) • 

While the present invention has been described in 
5 connection with .three preferred embodiments, it is to be 
understood that the subject matter encompassed by the 
present invention is not limited to those specific 
embodiments. On the contrary, it is intended to include 
all alternatives, modifications, and equivalents as can be 
10 included within the spirit and scope of the following 
claims. 
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